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IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 
Applicant : Siew Kok HUI 

Serial No : Not Yet Assigned (National Stage of PCT/SG99/001 19) 

Filed : Concurrently Herewith (International Filing Date November 12, 1999) 

For : SIGNAL PROCESSING APPARATUS 

PRELIMINARY AMENDMENT 

Commissioner of Patents and Trademarks 
Washington, D.C. 20231 

Sir: 

Prior to calculation of the filing fees and the examination of the above-identified 
patent application on the merits, the Examiner is respectfully requested to amend the claims 
as follows: 

IN THE CLAIMS 

Please amend claims 4, 5, 8, 9, 10, 12, 13, 16, 17, 18, 22, 23, 25, 27, 28, 35, 39, 42, 
and 46 as follows (a marked-up copy of the claim amendments is provided as an attachment 
to this Amendment): 

4. (Amended-Clean Text) A method as claimed in claim 2 wherein the noise energy 
is determined by measuring the signal energy E^ of blocks of the digitally converted signals 
and calculating the noise energy E^ in accordance with 
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Where the superscript K is the block number and a is an empirically chosen weight, 

5. (Amended-Clean Text) A method as claimed in claim 2 further comprising the 
steps of determining a noise threshold from the noise energy and updating the noise energy 
and noise threshold when the signal energy is below the noise threshold. 

8. (Amended-Clean Text) A method as claimed in claim 5 wherein the noise 
threshold T^j is determined in accordance with: 

Tnl = 6iE„ 

Where 6 1 is an empirically chosen value. 

9. (Amended-Clean Text) A method as claimed in claim 5 wherein the noise 
threshold T^ is determined in accordance with: 

T^ = 6 jE^ 

Where 62 is an empirically chosen value. 

10. (Amended-Clean Text) A method as claimed in claim 1 further comprising the 
step of determining the direction of arrival of the target signal. 

-2- 
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12. (Amended-Clean Text) A method as claimed in claim 10 further comprising the 
step of treating the signal as an unwanted signal if the signal has not impinged on the array 
from within a selected angular range. 

13. (Amended-Clean Text) A method as claimed in claim 1 further comprising the 
step of calculating a measure of the cross-correlation of signals from two spaced sensors of 
the array and freating the signal as an unwanted signal if the degree of cross correlation is 
less than a selected value. 

16. (Amended-Clean Text) A method as claimed in claim 14 further comprising the 
step of treating the signal as an unwanted signal if the reverberation measure indicates a 
degree of reverberation in excess of a selected value. 

17. (Amended-Clean Text) A method as claimed in claim 1 further comprising the 
step of controlling the operation of the first filter to perform adaptive filtering only when a 
said target signal is deemed to be present. 

18. (Amended-Clean Text) A method as claimed in claim 1 wherein the first adaptive 
filter has a plurality of channels receiving as input the digitized signals and providing as 
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output a sum and at least one difference signal, the difference signal channels including filter 
elements having corresponding filter weights. 

22. (Amended-Clean Text) A method as claimed in claim 1 further comprising the 
step of controlling the operation of the second filter to perform adaptive filtering only when 
a said target is deemed not to be present. 

23, (Amended-Clean Text) A method as claimed in claim 1 wherein the first adaptive 
filter has a plurality of channels receiving input signals from the first adaptive filter and 
providing as output a sum signal received from the first adaptive fiher, an error signal and 
at least one difference signal, the difference signal channels including ftirther filter elements 
having corresponding fiirther filter weights. 

25. (Amended-Clean Text) A method as claimed in claim 23 fiirther comprising the 
step of combining the sum signal and the error signal to form a single signal S(t) of the form: 

S(t) = W,S,(t) + W2e,(t) 
where S<.(t) is the sum signal at time t, e/t) is the error signal at time t and W i and W 2 are 
weight values. 
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27. (Amended-Clean Text) A method as claimed in claim 25 further comprising the 
step of applying a Manning window to the single signals. 

28. (Amended-Clean Text) A method as claimed in claim 1 further comprising the 
step of transforming the filtered signals into two frequency domain signals a desired signal 
Sf and an interference signal If, processing the transformed signals to provide a gain for the 
desired signal and transforming the gain modified desired signal back to the time domain to 
provide an output. 

35. (Amended-Clean Text) A method as claimed in claim 29 wherein the processing 
step includes the step of warping the signal and interference spectra into a Bark scale to form 
corresponding signal and interference Bark spectra. 

39. (Amended-Clean Text) A method as claimed in claim 29 further comprising the 
step of calculating a signal to noise ratio from the spectra and deriving the gain from the 
signal to noise ratio. 

42. (Amended-Clean Text) A method as claim 40 wherein the scaling factor changes 
exponentially. 
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46. (Amended-Clean Text) A method for performing the method of claim 1. 



REMARKS 

By the above amendment, claims 4, 5, 8, 9, 10, 12, 13, 16, 17, 18, 22, 23, 25, 27, 28, 
35, 39, 42, and 46 have been amended to delete multiple dependency. 

If there should be any questions, the Examiner is invited to contact the undersigned 
at the telephone number listed below. 



Respectfully submitted, 
Slew Kok HUI 




Reg. No. 29,027 



May 4, 2001 

GREENBLUM & BERNSTEIN, P.L.C. 
1941 Roland Clarke Place 
Reston,VA 20191 
(703)716-1191 
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MARKED-UP COPY OF AMENDED CLAIMS 

4. (Amended) A method as claimed in claim 2 [or claim 3] wherein the noise energy 
is determined by measuring the signal energy E^ of blocks of the digitally converted signals 
and calculating the noise energy E„ in accordance with 

E^^^' =ccE„'' + (l-(x)E,''-'^ 
Where the superscript K is the block number and a is an empirically chosen weight. 

5. (Amended) A method as claimed in claim 2 [any of claims 2 to 4] further 
comprising the steps of determining a noise threshold from the noise energy and updating the 
noise energy and noise threshold when the signal energy is below the noise threshold. 

8. (Amended) A method as claimed in claim 5 [any one of claims 5 to 7] wherein the 
noise threshold T^i is determined in accordance with: 

Tni = 6,E„ 

Where 6i is an empirically chosen value. 

9. (Amended) A method as claimed in claim 5 [any one of claims 5 to 7] wherein the 
noise threshold T„2 is determined in accordance with: 

Where 62 is an empirically chosen value. 
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10. (Amended) A method as claimed in claim 1 [any one of the preceding claims] 
further comprising the step of determining the direction of arrival of the target signal. 

12. (Amended) A method as claimed in claim 10 [or claim 1 1] further comprising the 
step of treating the signal as an unwanted signal if the signal has not impinged on the array 
from within a selected angular range. 

13. (Amended) A method as claimed in claim 1 [any one of the preceding claims] 
further comprising the step of calculating a measure of the cross-correlation of signals firom 
two spaced sensors of the array and treating the signal as an unwanted signal if the degree 
of cross correlation is less than a selected value. 

16. (Amended) A method as claimed in claim 14 [or claim 15] fiirther comprising the 
step of treating the signal as an unwanted signal if the reverberation measure indicates a 
degree of reverberation in excess of a selected value. 

17. (Amended) A method as claimed in claim 1 [any one of the preceding claims] 
further comprising the step of controlling the operation of the first filter to perform adaptive 
filtering only when a said target signal is deemed to be present. 

-8- 
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18. (Amended) A method as claimed in claim 1 [any one of the preceding claims] 
wherein the first adaptive filter has a plurality of channels receiving as input the digitized 
signals and providing as output a sum and at least one difference signal, the difference signal 
channels including filter elements having corresponding filter weights, 

22. (Amended) A method as claimed in claim 1 [any one of the preceding claims] 
further comprising the step of controlling the operation of the second filter to perform 
adaptive filtering only when a said target is deemed not to be present. 

23. (Amended) A method as claimed in claim 1 [any one of the preceding claims] 
wherein the first adaptive filter has a plurality of channels receiving input signals from the 
first adaptive filter and providing as output a sum signal received from the first adaptive 
filter, an error signal and at least one difference signal, the difference signal channels 
including fiirther filter elements having corresponding fiirther filter weights. 

25. (Amended) A method as claimed in claim 23 [or claim 24] fiirther comprising the 
step of combining the sum signal and the error signal to form a single signal S(t) of the form: 

S(t) = WiS,(t) + W2e,(t) 
where S^t) is the sum signal at time t, e^(t) is the error signal at time t and Wi and are 
weight values. 



P19913.A01 

27. (Amended) A method as claimed in claim 25 [or claim 26] further comprising the 
step of applying a Manning window to the single signals. 

28. (Amended) A method as claimed in claim 1 [any one of the preceding claims] 
further comprising the step of transforming the fdtered signals into two frequency domain 
signals a desired signal Sf and an interference signal [If] 1^ processing the transformed 
signals to provide a gain for the desired signal and transforming the gain modified desired 
signal back to the time domain to provide an output. 

35. (Amended) A method as claimed in claim 29 [any one of claims 29 to 34] wherein 
the processing step includes the step of warping the signal and interference spectra into a 
Bark scale to form corresponding signal and interference Bark spectra. 

39. (Amended) A method as claimed in claim 29 [any one of claims 29 to 38] further 
comprising the step of calculating a signal to noise ratio from the spectra and deriving the 
gain firom the signal to noise ratio. 

42. (Amended) A method as claim 40 [or claim 41] wherein the scaling factor 
changes exponentially. 
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46. (Amended) A method for performing the method of claim 1 [any one of the 
preceding claims]. 
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SIGNAL PROCESSING APPARATUS AND METHOD 



Backgroiind and Field of the Invention 



5 Tiiis invention relates to a method of signal processing and apparatus therefor. 



In many situations, observations are made of the output of a multiple input and multiple 
output system such as phase array radar system, sonar array system or microphone array 
system, from which it is desired to recover the wanted signal alone with all the 
10 unwanted signals, including noise, cancelled or suppressed. For example, in a 
microphone array system for a speech recognition application, the objective is to 
enhance the target speech signal in the presence of background noise and competing 
speakers. 

15 The most widely used approach to noise or interference cancellation in a multiple 
channel case was suggested by Widrow etc in "Adaptive Antemia Systems" Proc. IEEE, 
Vol.55 No. 12, Dec. 1967 and "Signal Cancellation Phenomena in Antennas: causes and 
cures", IEEE Trans. Antennas Propag., Vol.AP30, May 1982. Also by L.J.Griffiths etc 
in " An Alternative Approach to Linearly Constrained Adaptive Beamforming". IEEE 

20 Trans. Antennas Propag. VolAP30, 1982. In these and other similar approaches, the 
signal processing apparatus separates the observed signal into a primar>' channel which 
comprises both the target signal and the interference signal and noise, and a secondary 
channel which comprises interference signal and noise alone. The interference signals 
and noise in the primary channel are estimated using an adaptive filter having the 

25 secondary channel signal as input, the estimated interference and noise signal being 
subtracted from the primary charmel to obtain the desired target signal. 

There are tv^^o major drawbacks of the above approaches. The first is that it is assumed 
that the secondary channel comprises interference signals and noise only. This 
30 assumption may not be correct in practice due to leakage of wanted signals into the 
secondary channel due to hardware imperfections and limited array dimension. The 
second is that it is assumed that the interference signals and noise can be estimated 
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accurately from the secondary channel. This assumption may also not be correct in 
practice because this will required a large number of degrees of freedom, this implying 
a very long filter and large array dimension. A very long filter leads to other problems 
such as rate of convergence and instability. 

5 

The first drawback will lead to signal cancellation. This degrades the performance of the 
apparams. Depending on the input signal power, this degradation may be severe, leading 
to poor quality of the reconstructed speech because a portion of the desired signal is also 
cancelled by the filtering process. The second drawback will lead to poor interference 
!0 and noise cancellation especially low frequency interference signals the wavelengths of 
which are many times the dimension of the array. 

It is an object of the invention to provide an improved signal processing apparatus and 
method. 

15 

Summary of the Invention 

According to the invention in a first aspect, there is provided a method of processing 
signals received from an array of sensors comprising the steps of sampling and digitally 

20 converting the received signals and processing the digitally converted signals to provide 
an output signal, the processing including filtering the signals using a first adaptive filter 
arranged to enliance a target signal of the digitally converted signals and a second 
adaptive filter arranged to suppress an unwanted signal of the digitally converted signals 
and processing the filtered signals in the frequency domain to suppress the unwanted 

25 signal further. 

Further preferred features of the invention are recited in appendant claims 2-40. 

According to the invention in a second aspect, there is provided a method of calculating 
30 a spectrum from a coupled signal comprising the steps of: 

1) deriving a target signal component S and an interference signal component I from 
the coupled signal; 
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2) transforming the target and interference signal components into respective 
frequency domain equivalents F(S) and F(I);and 

3) constructing the spectrum P(S) and P(I) of at least one equivalent in accordance 
with: 

5 P(S)=!Real(F(S))! + |lmag(F(S))I + G[F(S)]*R(s) 

P(I)=lReal(F(I))! + |lmag(F(I))| + G[F(I)]*R(i) 
where Real and Imag refer to taking the absolute value of the real or imaginary part of 
the frequency domain equivalent R(s), R(i) are scalar adjustment factors and G[F(S)] and 
G[F(I)] are functions of F(S) and F(I) respectively. 

10 

According to the invention in a third aspect, there is provided a method of calculating 
a reverberation coefficient from a plurality of signals received from respective sensors 
in respective signal channels of a sensor array comprising the steps of: 
15 1) calculating a con-elation time delay between signals from a reference one of the 
channels and another one of the charmels using an adaptive filter; 

2) performing adaptive filtering, using a second adaptive filter, on the received 
signals ;and 

3) calculating a reverberation coefficient from the filter coefficients of the first and 
20 second filters. 

According to the invention in a fourth aspect, there is provided a method of signal 
processing of a signal having wanted and unwanted components comprising the steps 
of: 

25 1) processing the signal in the time domain with at least one adaptive filter to 
enhance the wanted signal and/or reduce the unwanted signal, 

2) transforming the thus processed signal to the frequency domain; and 

3) performing at least one unwanted signal reduction process in the frequency 
domain. 

30 

The invention extends to apparatus for performing the method of the aformentioned 
aspects. 
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Each aspect of the invention is usable independently of the others, for example in other 
signal processing apparatus which need not include other features of this invention as 
described. 

5 The described embodiment of the invention discloses a method and apparatus to enhance 
an observed target signal from a predetermined or known direction of arrival. The 
apparatus cancels and suppresses the unwanted signals and noise from their coupled 
observation by the apparatus. An approach is disclosed to enhance the target signal in 
a more realistic scenario where both the target signal and interference signal and noise 
10 are coupled in the observed signals. Further, no assumption is made regarding the 
number or the direction of arrival of the interference signals. 

The described embodiment includes an anray of sensors e.g. microphones each defining 
a corresponding signal channel, an array of receivers with preamplifiers, an array of 

15 analog to digital converters for digitally converting observed signals and a digital signal 
processor that processes the signals. From the observed signals, the apparatus outputs 
an enhanced target signal and reduces the noise and interference signals. The apparatus 
allows a tradeoff between interference and noise suppression level and signal quality. 
No assumptions are make about the number of interference signals and the characteristic 

20 of the noise. 

The digital signal processor includes a first set of adaptive filters which act as a signal 
spatial filter using a first channel as a reference channel. This filter removes the target 
signal "s" from the coupled signal and puts the remaining elements of the coupled 
25 signal, namely interference signals "u" and system noise "q" in an interference plus 
noise channel referred to as a Difference Channel. This filter also enhances the target 
signal "s" and puts this in another channel, referred to as the Sum Charmel. The Sum 
Channel consists of the enhanced target signal "s" and the interference signals "u" and 
noise "q". 

30 

The target signal "s" may not be removed completely from the Difference Channel due 
to the sudden movement of the target speaker or of an object within the vicinity of the 
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speaker, so this channel may contain some residue target signal on occasions which can 
lead to some signal cancellation. However, the described embodiment greatly reduces 
this. 

5 The signals from the Difference Channel are fed to a second adaptive filter set. This 
set of filters adaptively estimates the interference signals and noise in the Sum Channel. 

The estimated signals are fed to an Interference Signal and Noise Cancellation and 
Suppression Processor which cancels and suppresses the noise and interference signals 
10 from the Sum Channel and outputs the enhanced target signal. 

Updating of the parameters of tlie sets of adaptive filters is performed using a further 
processor termed a Preliminary Signal Parameters Estimator which receives the observed 
signal and estimates the reverberation level of the signal, the system noise level, the 
15 signal level, estimate signal detection thresholds and the angle of arrival of the signal. 
This information is used by the decision processor to decide if any parameter update is 
required. 

One application of the described embodiment of the invention is speech enhancement 
20 in a car environment where the direction of the target signal with respect to the system 
is known. Yet another application is speech input for speech recognition applications. 
Again the direction of arrival of the signal is known. 

25 Brief Description of the Drawings 

An embodiment of the invention will now be described by way of example with 
reference to the accompanying drawings in which: 

30 Fig. 1 illustrates a general scenario where the invention may be used. 

Fig.2 is a schematic illustration of a general digital signal processing system embodying 
the present invention. 
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Fig.3 is a system level block diagram of the described embodiment of Fig. 2. 

Fig. 4a-c is a flow chart illustrating the operation of the embodiment of Fig. 3. 

Fig 5 illustrates a typical plot of nonlinear energy of a channel and the established 

thresholds. 

5 Fig.6(a) illustrates a wavefront arriving from 40 degree off-boresight direction 
Fig 6(b) represents a time delay estimator using an adaptive filter 
Fig 6(c) shows the impulse response of the filter indicates a wave front from the 
boresight direction. 

Fig 7 illustrates the reverberation level of the received signal over time. 
10 Fig 8 shows the schematic block diagram the four channel Adaptive Spatial Filter. 
Fig 9 shows the schematic block diagram of the Adaptive Interference and Noise 
Estimator of Fig. 3. 
Fig 10 shows an input signal buffer. 

Fig 1 1 shows the use of a Manning Window on overlapping blocks of signals. 
15 Fig. 12 illustrates a sudden rise of noise level of the nonlinear energy plot. 

Fig. 13 illustrates the readjustment of the thresholds to reflect the sudden rise of noise 
energy level. 

Detailed Description of the Embodiment of the Invention 

20 

FIG.l illustrates schematically the operating environment of a signal processing 
apparatus 5 of the described embodiment of the invention, shown in a simplified 
example of a room. A target sound signal "s" emitted from a source s' in a known 
direction impinging on a sensor array, such as a microphone array 10 of the apparatus 

25 5, is coupled with other unwanted signals namely interference signals ul, u2 from other 
sources A,B, reflections of these signals ulr, u2r and the target signal's own reflected 
signal sr. These unwanted signals cause interference and degrade the quality of the 
target signal "s" as received by the sensor array. The actual number of unwanted signals 
depends on the number of sources and room geometry but only three reflected (echo) 

30 paths and three direct paths are illustrated for simplicity of explanation. The sensor 
array 10 is connected to processing circuitry 20-60 and there will be a noise input q 
associated with the circuitry which further degrades the target signal. 
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An embodiment of signal processing apparatus 5 is shown in FIG.2. The apparatus 
observes the environment with an array of four sensors such as microphones lOa-lOd. 
Target and noise/interference sound signals are coupled when impinging on each of the 
sensors. The signal received by each of the sensors is amplified by an amplifier 20a-d 
5 and converted to a digital bitstream using an analogue to digital converter 30a-d. The 
bit streams are feed in parallel to the digital signal processor 40 to be processed 
digitally. The processor provides an output signal to a digital to analogue converter 50 
which is fed to a line amplifier 60 to provide the final analogue output. 

10 FIG.3 shows the major functional blocks of the digital processor in more detail. The 
multiple input coupled signals are received by the four-channel microphone array 10a- 
lOd, each of which forms a signal channel, with channel 10a being the reference 
channel. The received signals are passed to a receiver front end which provides the 
functions of amplifiers 20 and analogue to digital converters 30 in a single custom chip. 

15 The four channel digitized output signals are fed in parallel to the digital signal 
processor 40. The digital signal processor 40 comprises four sub-processors. They are 
(a) a Preliminary Signal Parameters Estimator and Decision Processor 42, (b) a Signal 
Adaptive Spatial Filter 44, (c) an Adaptive Linear Interference and Noise Estimator 46, 
and (d) an Adaptive Interference and Noise Cancellation and Suppression Processor 48. 

20 The basic signal flow is from processor 42, to processor 44, to processor 46, to 
processor 48. These connections being represented by thick arrows in Fig. 3. The 
filtered signal S is output from processor 48. Decisions necessary for the operation of 
the processor 40 are generally made by processor 42 which receives information from 
processors 44 - 48, makes decisions on the basis of that information and sends 

25 instructions to processors 44 - 48, through connections represented by thin arrows in Fig. 
3. 

It will be appreciated that the splitting of the processor 40 into the four component parts 
42, 44, 46, 48 is essentially notional and is made to assist understanding of the operation 
30 of the processor. The processor 40 would in reality be embodied as a single multi- 
function digital processor performing the functions described under control of a program 
with suitable memory and other peripherals. 
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A flowchart illustrating the operation of the processors is shown in Figs 4a-c and this 
will firstly be described generally. A more detailed explanation of aspects of the 
processor operation will then follow. 

5 The front end 20,30 processes samples of the signals received from array 10 at a 
predetermined sampling frequency, for example 16kHz. The processor 42 includes an 
input buffer 43 that can hold N such samples for each of the four channels. Upon 
initialization, the apparatus collects a block of N/2 new signal samples for all the 
channels at step 500, so that the buffer holds a block of N/2 new samples and a block 

10 of N/2 previous samples. The processor 42 then removes any DC from the new samples 
and preemphasizes or whitens the samples at step 502. 

There then follows a short initialization period at step 504 in which the first 20 blocks 
of N/2 samples of signal after start-up are used to estimate the environment noise energy 
15 E„ and two detection thresholds, a noise threshold T„| and a larger signal tlireshold T^^, 
are calculated by processor 42 from E„ using scaling factors. During this short period, 
an assumption is made that no target signals are present. These signals do, however, 
continue to be processed, so that an initial Bark Scale system noise value may be 
derived at step 570, below. 

20 

After this initialisation period, the energies and thresholds update automatically as 
described below. The samples from the reference channel 1 Oa are used for this purpose 
although any other channel could be used. 

25 The total non-linear energy of the signal samples is then calculated at step 506. 

At step 508, it is determined if the signal energy is greater than the signal threshold 
T„,. If not, the envirormient noise and the two thresholds are updated at step 510 
using the new value of E^ calculated in step 506. The Bark Scale system noise (see 
30 below) is also similarly updated via point F. The routine then moves to point B. If so, 
the signal is passed to a threshold adjusting sub-routine 512-518. 
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Steps 512-518 are used to compensate for abrupt changes in environment noise level 
which may capture the tiu-esholds. A time counter is used to determine if the signal level 
shows a steady state increase which would indicate an increase in noise, since the 
speech target signal will show considerable variation over time and thus can be 

5 distinguished. This is illustrated in Fig. 12 in which a signal noise level rises from an 
initial level to a new level which exceeds both thresholds. At step 512 a time counter 
C, is incremented. At step 514 C, is checked against a threshold T,,. If the threshold 
is not reached, the program moves to step 520 described below. If the threshold is 
reached, the estimated noise energy E„ is then increased at step 516 by a muhiple a and 

10 E„, Tn, and T„2 are updated at step 518. The effect of this is illustrated in Fig. 13. The 
counter is reset and updating ceases when the the signal energy is less than the 
second threshold T^, as tested at step 520 below. 

A test is made at step 520 to see if the estimated energy in the reference channel 10a 
15 exceeds the second threshold T„2- If so, a candidate target signal is deemed to be present. 
The apparatus only wishes to process candidate target signals that impinge on the array 
10 from a known direction normal to the array, hereinafter referred to as the boresight 
direction, or from a limited angular departure therefrom, in this embodiment plus or 
minus 15 degrees. Therefore the next stage is to check for any signal arriving from this 
20 direction. 

At step 524 two coefficients are established, namely a correlation coefficient C.^ and a 
correlation time delay T^. which together provide an indication of the direction from 
which the target signal arrived. 

25 

At step 526, two tests are conducted to determine if the candidate target signal is an 
actual target signal. First, the crosscorrelation coefficient must exceed a 
predetermined threshold T^ and, second, the size of the time delay coefficient must be 
less than a value 9 indicating that the signal has impinged on the array within the 
30 predetermined angular range. If these conditions are not met, the signal is not regarded 
as a target signal and the routine passes to point B. If the conditions are met, the 
routine passes to point A. 
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If at step 520, the estimated energy in the reference channel 10a is found not to 
exceed the second threshold T^,, the target signal is considered not to be present and the 
routine passes to point B via step 522 in which the counter is reset. This is done 
since the second threshold at this point is above the level of the total signal energy 
5 indicating that the threshold must be, consequently, above the environment noise energy 
level E„ and thus updating of E„ is no longer necessar>'. 

Thus, the signal has, by points A and B, been preliminarily classified into a target signal 
(point A) or a noise signal (point B). 

10 

Following point A, the signal is subject to a further test at steps 528-532. At step 528. 
it is determined if the filter coefficients of filter 44 have yet been updated. If not. 
the subsequent steps 530, 532 are skipped, since these rely on the coefficients of filter 
44 for calculation purposes. If so, a reverberation coefficient C^^. v/hich provides a 
15 measure of the degree of reverberation of the signal is calculated and at step 532 it is 
determined if C„ exceeds a threshold T„ If so, this indicates an acceptable level of 
reverberation in the signal and the routine passes to step 534 (target signal filtering). 
If not, the signal joins the path from point B to step 536 (non-target signal filtering). 

20 The now confirmed target signal is fed to the Signal Adaptive Spatial Filter 44, the 
purpose of which is to enhance the target signal. The filter is instructed to perform 
adaptive filtering at steps 534 and 538, in which the filter coefficients are adapted 
to provide a "target signal plus noise" signal in the reference channel and "noise only" 
signals in the remaining channels using the Least Mean Square (LMS) algorithm. The 

25 filter 44 output channel equivalent to the reference channel is for convenience referred 
to as the Sum Channel and the filter 44 output from the other channels. Difference 
Channels. The signal so processed will be, for convenience, referred to as A'. 

If the signal is considered to be a noise signal, the routine passes to step 536 in which 
30 the signals are passed through filter 44 without the filter coefficients being adapted, to 
form the Sum and Difference channel signals. The signals so processed will be referred 
to for convenience as B'. 
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The effect of the filter 44 is to enhance the signal if this is identified as a target signal 
but not otherwise. 

At step 540, an energy ratio R^^ between the Sum Channel and the Difference Channels 
5 is estimated by processor 42. At step 542 two tests are made. First, if the signals are 
A' signals from step 534, the routine passes to step 550. Second, for those signals for 
which E>Tn, (i.e., high energy level), R^j is compared to a threshold T^^. If the ratio 
is lower than Ts^, this indicates probable noise but if higher, this may indicate that there 
has been some leakage of the target signal into the Difference channel, indicating the 
10 presence of a target signal after all. For such target signals the routine also passes to 
step 550. For all other non-target signals, the routine passes to step 544. 

At steps 544-560, the signals are processed by the Adaptive Linear Interference and 
Noise Estimation Filter 46, the purpose of which is to reduce the unwanted signals. The 
1 5 filter 46, at step 544, is instructed to perform adaptive filtering on the non- target signals 
with the intention of adapting the filter coefficients to reducing the unwanted signal in 
the Sum channel to some small error value e^. 

To further prevent signal cancellation, the norm of the filter coefficients is calculated 
20 by processor 42 at step 546. If this norm exceeds a predetermined value [T^J at step 
548, then the filter coefficients are scaled at step 549 to a reduced value. 

In the alternative, at step 550, the target signals are fed to the filter 46 but this time, no 
adaptive filtering takes place, so the Sum and Difference signals pass through the filter. 

25 

An output of the Sum Channel signal without alteration is also passed through the filter 
46. 

The output signals from processor 46 are thus the Sum channel signal S,. (point C), 
30 filtered Difference signals D,. (point E) and the error signal e, (point D). At step 562, 
a weighted average S(t) of the error signal e^ and the Sum Channel signal is calculated 
and the signals from the Difference channels D^ are Summed to form a single signal I(t). 
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These signals S(t) and I(t) are then collected for the new N/2 samples and the last N/2 
samples from the previous block and a Manning Window H„ is applied to the collected 
samples as shown in Fig. 10 to form vectors and 1^. This is an overlapping technique 
with overlapping vectors S„,I„ being formed from past and present blocks of N/2 samples 
5 continuously. This is illustrated in Fig. 11. A Fast Fourier Transform is then performed 
on the vectors Sj, and 1^ to transform the vectors into frequency domain equivalents St- 
and I,-, at step 564. 

At step 566 a modified spectrum is calculated for the transformed signals to provide 
10 "pseudo" spectrum values and Pj and these values are warped into the same Bark 
Frequency Scale to provide Bark Frequency scaled values B^ and B, at step 568. 

The Bark value B^ of the system noise of the Sum Channel is updated at step 570 using 
Bj and the previous value of B„, if the condition at step 508 is met (through path F). 
15 At start-up, B„ is initially calculated at this block whether or not the condition is met. 
At this time, there must be no target signal present, thus requiring a short initialization 
period after signal detection has begun, for this initial B„ value to be established. 

A weighted combination By of and Bj is then made at step 572 and this is combined 
20 with Bj to compute the Bark Scale nonlinear gain at step 574. 

Gb is then unwarped to the normal frequency domain to provide a gain value G at step 
578 and this is then used at step 580 to compute an output spectrum S^^j using the signal 
spectrum Sf from step 564. This gain-adjusted spectrum suppresses both the interference 
25 signals, the environmental noise and system noise. 

An inverse FFT is then performed on the spectrum S^^, at step 582 and the output signal 
is then reconstructed from the overlapping signals using the overlap add procedure at 
step 584. 

30 

Major steps in the above described flowchart will now be described in more detail. 



' i lll il.l l iIMP 
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NonLinear Energy and Tlireshold Estimation and Uodatine (STEPS 506.510^ 

The processor 42 estimates the energy output from a reference channel. In the four 
channel example described, channel 10a is used as the reference channel. 

N/2 samples of the digitized signal are buffered into a shift register to form a signal 
vector of the following form: 



X{0) 
Xil) 



[X{J-1)\ 



Where J = N/2. The size of the vector depends on the resolution requirement. In the 
preferred embodiment, J=256 samples. 

The nonlinear energy of the vector is then estimated using the following equation: 



= ^(i)^ - A. 2 



When the system is initialized, the average system and environment noise energy is 
estimated xising the first 20 blocks of signal. A first order recursive filter is used to 
carry out this task as shown below:. 

20 

En*'^ = aE^ + {2.-a)E^*^ . . .A.3 



Where the superscript K is the block number and a is an empirically chosen weight 
between zero and one. In this embodiment, a = 0.9. 



wo 00/30264 PCT/SG99/00119 

14 

Once the noise energy is obtained, the two signal detection thresholds Tnl and T„2 
are established as follows: 



5, and are scalar values that are used to select the thresholds so as to optimize signal 
5 detection and minimize false signal detection. As shown in Fig. 5, T^, should be above 
the system noise level, with T^, sufficient to be generally breached by the potential 
target signal. These thresholds may be found by trial and error. In this embodiment, 
6|=1.125 and 52=1.8 have been found to give good results. 

10 Once the thresholds have been established, E„ may be updated after initialization in step 
510 as follows: 



If < r,, 
E^=a^ + {1-a) 
Else 
B„ = 

. . .A. 6 

15 The updated thresholds may then be calculated according to equations A.4 and A.5. 
Time Delay Estimation (T.) (STEP 524) 



FIG 6A illustrates a single wave front unpinging on the sensor array. The wave front 
20 impinges on sensor lOd first (A as shown) and at a later time impinges on sensor 10a 
(A' as shown), after a time delay t^. This is because the signal originates at an angle of 
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40 degrees from the boresight direction. If the signal originated from the boresight 
direction, the time delay t^ will have been zero ideally. 

Time delay estimation of perfomied using a tapped delay line time delay estimator 
5 included in the processor 42 which is shown in Fig. 6B. The filter has a delay element 
600 ,having a delay Z"^, connected to the reference channel 10a and a tapped delay line 
filter 610 having a filter coefficient W^j connected to channel lOd. Delay element 600 
provides a delay equal to half of that of the tapped delay line filter 610. The outputs 
from the delay element is d(k) and from filter 610 is d'(k). The Difference of these 
10 outputs is taken at element 620 providing an error signal e(k) (where k is a time index 
used for ease of illustration). The error is fed back to the filter 610. The Least Mean 
Squares (LMS) algorithm is used to adapt the filter coefficient \V,j as follows: 



. . . .B. 1 



B.2 



S°oc^{k) 
S^odik) 



B. 3 



S^%{k) 
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e{;c) = d{k) - d'(ic) B4 

d'{k) = W,^{k)'^.S^^^{k) B.5 



5 where p.^ is a user selected convergence factor 0<p,d<2, || || denoted the norm of a 
vector, k is a time index, L,, is the filter length. 

The impulse response of the tapped delay line filter 620 at the end of the adaptation is 
shown in Fig. 6c. The impulse response is measured and the position of the peak or the 

10 maximum value of the impulse response relative to origin O gives the time delay Tj 
between the two sensors which is also the angle of arrival of the signal. In the case 
shown, the peak lies at the centre indicating that the signal comes from the boresight 
direction (Trf=0). The threshold 6 at step 506 is selected depending upon the assumed 
possible degree of departure from the boresight direction from which the target signal 

15 might come. In this embodiment, 6 is equivalent to 
± 15°. 

Normalized Cross Correlation Estimation C ("STEP 524) 

20 The normalized crosscorrelation between the reference chaimel 10a and the most distant 
channel lOd is calculated as follows: 

Samples of the signals from the reference channel 10a and chaimel lOd are buffered into 
shift registers X and Y where X is of length J samples and Y is of length K samples, 
25 where J>K, to form two independent vectors X^ and Y^: 



PCT/SG99/00n9 



yr(2) 



A time delay between the signals is assumed, and to capture this Difference, J is made 
5 greater than K. The Difference is selected based on angle of interest. The normalized 
cross-correlation is then calculated as follows: 



CAD = 



X,{1) 

xAl+i) 



x^{K+l-l) 



10 Where represents the transpose of the vector and |||| represent the norm of the vector 
and 1 is the correlation lag. 1 is selected to span the delay of interest. For a sampling 
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frequency of 16kHz and a spacing between sensors 10a,10d of 18cm, the lag 1 is 
selected to be five samples for an angle of interest of 15°. 

The threshold T, is determined empirically. T, = 0.85 is used in this embodiment. 

5 

Signal Reverberation Estimation C, .. (STEP 530) 

The degree of reverberation of the received signal is calculated using the time delay 
estimator filter weight [WJ used in calculation of T^ above and the set of spatial filter 
10 weights [W3J from filter 44 (described below) as shov\'n in the following equation: 

Where represents the transpose of the vector and M is the channel associated with the 
filter coefficient W^,,. In this embodiment, three values for C^., one for each filter 
coefficient W^^ are calculated. The largest is taken for subsequent processing. 

15 

The threshold T„ used in step 506 is selected to ensure that the signal is selected as a 
target signal only when the level of reverberation is moderate, as illustrated in Fig. 7. 

Adaptive Spatial Filter 44 (STEPS 534.536') 

20 

FIG.8 shows a block diagram of the Adaptive Linear Spatial Filter 44. The function of 
the filter is to separate the coupled target interference and noise signals into two types. 
The first, in a single output channel termed the Sum Channel, is an enhanced target 
signal having weakened interference and noise i.e. signals not from the target signal 
25 direction. The second, in the remaining channels termed Difference Channels, which in 
the four channel case comprise three separate outputs, aims to comprise interference and 
noise signals alone. 



The objective is to adapt the filter coefficients of filter 44 in such a way so as to 
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enhanced the target signal and output it in the Sum Channel and at the same time 
eliminate the target signal from the coupled signals and output them into the Difference 
Channels. 

5 The adaptive filter elements in filter 44 act as linear spatial prediction filters that predict 
the signal in the reference channel whenever the target signal is present. The filter stops 
adapting when the signal is deemed to be absent. 

The filter coefficients are updated whenever the conditions of steps 504 and 506 are 
10 met, namely: 

(i) The adaptive threshold detector detects the presence of signal; 

(ii) The time delay estimator indicates that the signal arrived from the predetermined 
angle; 

(iii) The normalized cross correlation of the signal exceeds the threshold; and 
15 (iv) The reverberation level is low. 

As illustrate in FIG.8, the digitized coupled signal Xg from sensor 1 Oa is fed through 
a digital delay element 710 of delay Z'*-^"-'-. Digitized coupled signals XjjXjjXj fi-om 
sensors 10b,10c,10d are fed to respective filter elements 712,4,6. The outputs from 

20 elements 710,2,4,6 are Summed at Summing element 718, the output from the Summing 
element 718 being divided by four at divider element 719 to form the Sum channel 
output signal. The output from delay element 710 is also subtracted from the outputs of 
the filters 712,4,6 at respective Difference elements 720,2,4, the output from each 
Difference element forming a respective Difference channel output signal, which is also 

25 fed back to the respective filter 712,4,6. The function of the delay element 710 is to 
time align the signal from the reference channel lOa with the output from the filters 
712,4,6. 

The filter elements 712,4,6 adapt in parallel using the LMS algorithm given by 
30 Equations E.1..E.8 below, the output of the Sum Channel being given by equation E.l 
and the output firom each Difference Channel being given by equation E.6: 
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4(Jc) = {Sik) ^ X^{k))/4 ...E.l 



Where: S{k) =5^5^(ic) ...£".2 



S^ik) = {W^l(k))-' Xjk) . . . .£.3 

Where m is 0,1,2...M-1, the number of channels, in this case 0..3 and ^ denotes the 
transpose of a vector. 



XAk) = 



Wsuik) = 



f^SULSuik) 



Where Xn,(k) and ^/^^"(k) are column vectors of dimension Lju^l. 
The weight W^J"(k) is updated using the LMS algorithm as follows: 
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a^^(ic) = Xjk) - S^{k) ...E.6 



Where-. 



ll^;„{ic)|i 



and where p^^ is a user selected convergence factor Q<^^^<2, |||| denoted the norm of 
a vector and k is a time index. 



Calculation of Energy Ratio R . /step 540) 
This is performed as follows: 











4^(0) 




4^(0) ■ 






4.(1) 




4^(1) 




4.(1) 








+ 
















42(^^-1) 




43 ('^-D, 



J=N/2, the number of samples, in this embodiment 256. 
10 Where E^um is the sum chaimei energy and Ed,f is the difference channel energy. 



EsoM = -jEsE 4(J)' - 4(J-i) 4(i-i) 
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The energy ratio between the Sum Channel and Difference Channel (R^^) must not 
exceed a predetermined threshold. In the four channel case illustrated here the threshold 
5 isdetermined to be about 1.5. 

Adaptive Interference and Noise Estimation Filter 46 (STEPS 544.550') 

FIG. 9 shows a schematic block diagram of the Adaptive Interference and Noise 
10 Estimation Filter 46. This filter estimates the noise and interference signals and 
subtracts them from the Sum Charmel so as to derive an output with reduced noise and 
interference. 

The filter 46 takes outputs from the Sum and Difference Channels of the filter 44 and 
1 5 feeds the Difference Channel Signals in parallel to another set of adaptive filter elements 
750,2,4 and feeds the Sum Channel signal to a corresponding delay element 756. The 
outputs from the three filter elements 750,2,4 are subtracted from the output from delay 
element 756 at Difference element 758 to form an error output e^, v/hich is also fed back 
to the filter elements 750,2,4. The output from filter element 756 is also passed 
20 directly as an output, as are the outputs from the three filter elements 750,2,4. 

Again, the Least Mean Square algorithm (LMS) is used to adapt the filter coefficients 
Wuq as follows: 

25 
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e,{k) = S^ik) - Y^a,Jk) ...G.l 
Where: a^^{k) = W^^ik)'' . ^"{k) . . .G.: 



Y'"{k) = 



dczJk) 
^c2Jk) 



<g{ic+l) = <^(Jc) + 2yLZgy"ik)e^{k) 



and where is a user selected convergence factor 0<p„q<2 and where m is 0,1,2...M-1, 
the number of channels, in this case 0..3. 



Calculation of Norm of filter coefficients (step 546) 

The norms of the coefficients of filters 750,2,4 are also constrained to be smaller than 
a predetermined value. The rationale for imposing this constraint is because the norm 
15 of the filter coefficients will be large if a target signal leaks into the Difference Channel. 
Scaling down the norm value of the filter coefficients will reduce the effect of signal 
cancellation. 
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This is calculated as follows: 



If: 



no 



. . . . G.6 



Then: 




'no 



. . . .G.l 



Where m is 1,2...M-1, the channels having fihers. T„<, is a predetermined threshold 
and C„o is a scaling factor, both of which can be estimated empirically. 



The output e, from equation F.l is almost interference and noise free in an ideal 
situation. However, in a realistic situation, this can not be achieved. This will cause 
signal cancellation that degrades the target signal quality or noise or interference will 
feed through and this will lead to degradation of the output signal to noise and 
10 interference ratio. The signal cancellation problem is reduced in the described 
embodiment by use of the Adaptive Spatial Filter 44 which reduces the target signal 
leakage into the Difference Channel. However, in cases where the signal to noise and 
interference is very high, some target signal may still leak into these channels. 

15 To further reduce the target signal cancellation problem and unwanted signal feed 
tlirough to the output. The output signals from processor 46 are fed into the Adaptive 
NonLinear Interference and Noise Suppression Processor 48 as described below. 

Adaptive Nonl .in ea r Interference and Noise Suppression Processor 48 TSTEPS 562-584> 

20 

This processor processes input signals in the frequency domain coupled with the well- 
known overlap add block processing technique. 

STEP 562: The output signal (e,) and the Sum Channel output signal (S^) combined 
25 as a weighted average as follows: 



5 



.H. 1 
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The weights (W,,W2) can be empirically chosen to minimize signal cancellation or 
improve unwanted signal suppression. In this embodiment, W,=W2=0.5. 

5 This combined signal is buffered into a memory as illustrated in FIG, 10. The buffer 
consists of N/2 of new samples and N/2 of old samples from the previous block. 
Similarly, the unwanted signals from the Difference Channel are summed in accordance 
with the following and buffered the same way as the Sum Channel: 



M-l 



lit) = j;^D,, 

i=l 



. . . .H.2A 



d^i(l) 



Where : 



. . .H.2B 



10 Where i= 1,2... M-l and M is the number of channels, in this case M=4. 



A Manning Windov/ is then applied to the N samples buffered signals as illustrated in 
FIG. 11 expressed mathematically as follows: 
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H„ ...H.4 



Where (H„) is a Harming Window of dimension N, N being the dimension of the buffer. 
The "dot" denotes point by point multiplication of the vectors, t is a time index. 

5 Step 5.64: The resultant vectors [S,,] and [IJ are transformed into the frequency 
domain using Fast Fourier Transform algoritlim as iikistrated in equations H.5 and H.6 
below: 

Sf = FFTiS^) H.5 

If = FFT{I^) H.e 



Step 566: A modified spectrum is then calculated, which is illustrated in Equations 
10 H.7 and H.8: 



= \Real{Sf) I + \lmag{Sf) \ + FiS^) 



= \Real{If) I + \lmag{If) \ + F(J^) ^r^ 



Where "Real" and "Imag" refer to taking the absolute values of the real and imaginary 
parts, and i; are scalars and F(Sf) and F(If) denotes a function of Sf-and I,- respectively. 



15 



One preferred function F using a power fimction is shown below in equations H.9 and 
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H.IO where "Conj" denotes the complex conjugate: 
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= \Real{Sf)\ + \lmag{Sf)\ + {Sf*conj iS^) ) . . .H.S 

= \Real{If)\ + |X/na5r( J^.) I + {If*conj (1^) ) ...H.IO 

A second preferred function F using a multiplication ftmction is shown below in 
5 equations H.ll and H.12: 

= \RealiS^)\ + \lmaff{Sf)\ + \Real{Sf)\ * \lmaff{S^)\ H.ll 

Pi = \Real{I^) \ + \lmacr{If) \ + \Real{If) \ * \lmaff{If) \ H.12 

The values of the scalars (r^ and tj) control the tradeoff between unwanted signal 
suppression and signal distortion and may be determined empirically, (r^ and rj) are 
10 calculated as 1/(2"^) and 1/(2"') where vs and vi are scalars. In this embodiment, vs=vi 
is chosen as 8 giving rs=ri = 1/256. As vs,vi reduce, the amount of suppression will 
increase. 

Step 568: The Spectra (P^) and (Pj) are warped into (Nb) critical bands using the 
15 Bark Frequency Scale [see Lawrence Rabiner and Bing Hwang Juang, Fundamentals of 
Speech Recognition, Prentice Hall 1993]. The number of Bark critical bands depend on 
the sampling frequency used. For a sampling of 16Khz, there will be Nb = 25 critical 
bands. The warped Bark Spectrum of (Pj) and (Pj) are denoted as (Bj) and (Bj). 

20 Step 570: A Bark Spectrum of the system noise and environment noise is similarly 
computed and is denoted as (B„). B„ is first established during system initialization as 
B„=Bj and continues to be updated when no target signal is detected (step 508) by the 
system i.e. any silence period. B^ is updated as follows: 
If E,<T„, 
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B„ = aB„ + (\-a)B, 

Else 

B„ = B„ 

H.13 

5 Where 0<a<I; in this embodiment, a=0.9 
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Steps 572,574: Using (B„ B, and B„) a nonlinear technique is used to estimate a 

gain (Gb) as follows : 

10 First the unwanted signal Bark Spectrum is combined with the system noise Bark 
Spectrum using an appropriate weighting function as illustrate in Equation J.l. 

By = Q^Bj^ + Q^B^ ... J. 1 

Q, and Q2 weights which can be chosen empirically so as to maximize unwanted 
15 signals and noise suppression with minimize signal distortion. 

Follow that a post signal to noise ratio is calculated using Equations J.2 and J.3 below: 

^po = 1^ • ■ .J-2 

The division in equation J.2 means element by element division and not vector division. 
20 and Rpp are column vectors of dimension Nb*l, Nb being the dimension of the Bark 
Scale Critical Frequency Band and I, is a column unity vector of dimension Nb*l as 
shown below: 



25 
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'-poii) 



'■PPU) 
^PPU) 



If any of the rpp(nb)elements of Rpp are less than zero, they are set equal to zero. 

Using the Decision Direct Approach [see Y. Ephraim and D. Malah: Speech 
5 Enhancement Using Optimal NonLinear Spectrum Amplitude Estimation; Proc. IEEE 
International Conference Acoustics Speech and Signal Processing (Boston) 1983, 
pplll8-1121.], the a-priori signal to noise ratio Rp^ is calculated as follows: 

V = (1-Pi)*i?pp-^ Pi 1^ ....7.7 

The division in Equation J.7 means element by element division. is a column 
10 vector of dimensions Nb*l and denotes the output signal Bark Scale Bark Spectrum 
from the previous block Bo=G5.Bs (see Eqn J. 15) (B„ initially is zero). Rp, is also a 
column vector of dimension Nb*l. The value of (3; is given in Table 1 below: 
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i 


P 


1 


0.01625 


2 


0.01225 


3 


0.245 


4 


0.49 


5 


0.98 



TABLE 1 



10 The value i is set equal to 1 on the onset of a signal and the P value is therefore equal 
to 0.01625. Then the i value will count from 1 to 5 on each new block of N/2 samples 
processed and stay at 5 until the signal is off. The i will start from 1 again at the next 
signal onset and the P is taken accordingly. 

15 Instead of p being constant, in this embodiment P is made variable and starts at a small 
value at the onset of the signal to prevent suppresion of the target signal and increases, 
preferably exponentially, to smooth Rp^. 

From this, R„ is calculated as follows: 



The division in Equation J. 8 is again element by element. Rrr is a column vector of 
dimension Nb* 1 . 



From this, is calculated: 
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The value of is limited to Pi («3.14). The multiplication in Equation J.9 means 
element by element multiplication. is a column vector of dimension Nb* 1 as shown 
below: 



1A2) 



A vector L of dimension Nb* 1 is then defined as: 



lyil) 
ly{2) 



lyinb) 



ly(Nb) 



15 Where nb = l,2...Nb. Then Ly is given as: 
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lyinb) = expj 



E(nb) \ 



and 



E{nh) 



-0 . 57722 
1 



- log il^inb)) + l^(nb)-{l^{nb))^/4 



E(nb) is tmncated to the desired accuracy. Ly can be obtained using a table look-up 
approach to reduce computational ioad. 

Finally, the Gain is calculated as follows: 

= R^^.Ly . . . J-.14 



The "dot" again implies element by element multiplication. is a column vector of 
dimension Nb*l as shown: 



g{nh) 



.g{Nb) 



Step 578: As G^ is still in the Bark Frequency Scale, it is then unwarped back to 
the normal linear frequency scale of N dimensions. The unwarped G^ is denoted as G. 
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The output spectrum with unwanted signal suppression is given as: 
= G.S^ ... J. 16 

The "dot" again implies element by element multiplication. 
5 Step 580: The recovered time domain signal is given by: 

= Real {IFFTiSf) ) ... J. 17 

IFFT denotes an Inverse Fast Fourier Transform, with only the Real part of the inverse 
transform being taken. 

10 

Step 584: Finally, the output time domain signal is obtained by overlap add with the 
previous block of output signal : 





■ S,{1) 




Z,{1) " 














+ 






S^{N/2) 







'S,.^{l+N/2) 
S,.,(2+i\7/2) 



5^.1 iN) 



15 
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The embodiment described is not to be construed as limitative. For example, there can 
be any number of channels from two upwards. Furthermore, as will be apparent to one 
skilled in the art, many steps of the method employed are essentially discrete and may 
be employed independently of the other steps or in combination with some but not all 
5 of the other steps. For example, the adaptive filtering and the frequency domain 
processing may be performed independently of each other and the frequency domain 
processing steps such as the use of the modified spectrum, warping into the Bark scale 
and use of the scaling factor p can be viewed as a series of independent tools which 
need not all be used together. 

10 

Use of first, second etc. in the claims should only be construed as a means of 
identification of the integers of the claims, not of process step order. Any novel feature 
or combination of features disclosed is to be taken as forming an independent invention 
whether or not specifically claimed in the appendant claims of this application as 
15 initially filed. 
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CLAIMS 

1 . A method of processing signals received from an array of sensors comprising the 
steps of sampling and digitally converting the received signals and processing the 
digitally converted signals to provide an output signal, the processing including filtering 
5 the signals using a first adaptive filter arranged to enhance a target signal of the digitally 
converted signals and a second adaptive filter arranged to suppress an unwanted signal 
of the digitally converted signals and processing the filtered signals in the frequency 
domain to suppress the unwanted signal further. 

10 2. A method as claimed in claim 1 further comprising the step of determining a 
signal energy from the signals and determining a noise energy from the signal energy. 

3. A method as claimed in claim 2 wherein the signal energy is determined by 
buffering N/2 samples of the digitized signal into a shift register to form a signal vector 
15 of the following form: 



X{0) 
X{1) 



X{J--1) 



Where J = N/2; and estimating the signal energy using the following equation: 



^-2 fr^ 



where is the signal energy. 



4. A method as claimed in claim 2 or claim 3 wherein the noise energy is 
determined by measuring the signal energy E, of blocks of the digitally converted signals 
25 and calculating the noise nergy E„ in accordance with: 
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Where the superscript K is the block number and a is an empirically chosen weight. 

5. A method as claimed in any one of claims 2 to 4 further comprising the step of 
5 determining a noise threshold from the noise energy and updating the noise energy and 

noise threshold when the signal energy is below the noise threshold. 

6. A method as claimed in claim 5 further comprising the step of determining if a 
target signal is present by comparing the signal energy to a signal threshold. 

10 

7. A method as claimed in claim 6 fiirther comprising the step of determining the 
signal threshold from the noise energy and updating the signal threshold when the signal 
energy is below the noise threshold. 

15 8. A method as claimed in any one of claims 5 to 7 wherein the noise threshold T„, 
is determined in accordance with: 

Where 6, is an empirically chosen value. 

9. A method as claimed in claim 6 or claim 7 wherein the signal threshold T^, is 
20 determined in accordance with: 



Where 6, is an empirically chosen value. 

10. A method as claimed in any one of the preceding claims further comprising the 
step of determining the direction of arrival of the target signal. 

25 

11. A method as claimed in claim 10 further comprising the step of processing the 
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signals from two spaced sensors of the array with a third adaptive filter to determine 
said direction of arrival. 

12. A method as claimed in claim 10 or claim 11 further comprising the step of 
5 treating the signal as an imwanted signal if the signal has not impinged on the array 

from v/ithin a selected angular range. 

13. A method as claimed in any one of the preceding claims further comprising the 
step of calculating a measure of the cross-correlation of signals from two spaced 

10 sensors of the array and treating the signal as an unwanted signal if the degree of cross 
correlation is less than a selected value. 

14. A method as claimed in claim 11 further comprising the step of calculating a 
measure of reverberation of the signal from filter weights of the first and third adaptive 

15 filters. 

15. A method as claimed in claim 14 wherein the reverberation measure C^, is 
calculated in accordance with 



C = ^su 

20 

where T denotes the transpose of a vector, is the filter coefficient of the first filter 
and W,d is the filter coefficient of the third filter. 

16. A method as claimed in claim 14 or claim 15 flirther comprising the step of 
25 treating the signal as an unwanted signal if the reverberation measure indictates a degree 

of reverberation in excess of a selected value. 

17. A method as claimed in any one of the preceding claims further comprising the 
step of controlling the operation of the first filter to perform adaptive filtering only when 
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a said target signal is deemed to be present. 
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18. A method as claimed in any one of the preceding claims wherein the first 
adaptive filter has a plurality of channels receiving as input the digitized signals and 

5 providing as output a sum and at least one difference signal, the difference signal 
charmels including fiher elements having corresponding filter weights. 

1 9. A method as claimed in claim 1 8 further comprising the step of calculating a 
ratio of the energy in the sum and difference channels. 

10 

20. A method as claimed in claim 19 further comprising the step of treating the 
signal as including a said target signal if the ratio indicates that the energy in the sum 
channel is greater than the energy in the difference channels by more than a selected 
factor. 

15 

21. A method as claimed in claim 20 further comprising the step of treating the 
signal as including a said target signal only if the signal energy exceeds a threshold. 

22. A method as claimed in any one of the preceding claims further comprising the 
20 step of controlling the operation of the second filter to perform adaptive filtering only 

when a said target signal is deemed not to be present. 

23. A method as claimed in any one of the preceding claims wherein the first 
adaptive filter has a plurality of channels receiving input signals from the first adaptive 

25 filter and providing as output a sum signal received from the first adaptive filter, an 
error signal and at least one difference signal, the difference signal channels including 
further filter elements having corresponding fiirther filter weights. 

24. A method as claimed in claim 23 further comprising the step of scaling the 
30 further filter weights if the norms of the further filter weights exceed a threshold. 



25. 



A method as claimed in claim 23 or claim 24 further comprising the step of 
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combining the sum signal and the error signal to form a single signal S(t) of the form: 

Sit) = W^S^it) * W^e^it) 

where S,(t) is the sum signal at time t, e,(t) is the error signal at time t and W, and W, 
are weight values. 

5 26. A method as claimed in claim 25 further comprising the step of combining the 
difference signals to form a single signal. 

27. A method as claimed in claim 25 or claim 26 further comprising the step of 
applying a Hanning window to the single signals. 

10 

28. A method as claihied in any one of the preceding claims further comprising the 
step of transforming the filtered signals into two frequency domain signals a desired 
signal Sf and an interference signal 1^, , processing the transformed signals to provide a 
gain for the desired signal and transforming the gain modified desired signal back to the 

15 time domain to provide an output. 

29. A method as claimed in claim 28 wherein the processing step comprises the step 
of forming spectra for the frequency domain signals. 

20 30. A method as claimed in claim 29 whererin the spectra are modified spectra P^, 
P; of the desired signal and the interference signal of the form: 

= \RealiSf) I + \lmagiSf) \ + F{Sf) 
= \Real{If) I + \lmag{If) \ + F{If) 

Where "Real" and "Imag" refer to taking the absolute values of the real and imaginary 
parts, X, and T; are scalars and F(Sf) and F(If) denotes a function of Sf and I,- respectively. 

25 

31. A method as claimed in claim 30 wherein the function is a power function. 
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32. A method as claimed in claim 31 wherein the spectra are of the form, where 
"Conj" denotes the complex conjugate: 

= \Real(If)\ + |Jinasr(j^)| + (i^*conj Uf) ) *r,. 
= \Real{S^)\ + \lmag{Sf)\ + {S^*conj {S^) ) 

33. A method as claimed in claim 30 wherein the function is a multiplication 
5 function 

34. A method as claimed in claim 33 wherein the spectra are of the form: 
P^ = \Real{Sf) j + \imag{S^) \ + \Real{Sf) \ * \lmagiS^) \ 

Pi = \Real{If) I + \lmag{I^) \ + \Real{If) | * |Ji77ag'(J^) | *r,. 

35. A method as claimed in any one of claims 29 to 34 wherein the processing step 
1 0 includes the step of warping the signal and interference spectra into a Bark scale to form 

corresponding signal and interference Bark spectra. 

36. A method as claimed in claim 35 wherein the processing step further includes 
the step of calculating a system noise Bark spectrum. 

15 

37. A method as claimed in claim 36 further comprising the step of combining the 
interference Bark spectrum and the system noise Bark spectrum to form a combined 
noise Bark spectrum. 

20 38. A method as claimed in claim 37 wherein the combined noise Bark spectrum By 
is of the following form: 



By = Q^Bj + a^B^ 
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where Q, and Q.2 are weighting values B, is the interference Bark spectrum and B„ is the 
system noise Bark spectrum. 

39. A method as claimed in any one of claims 29 to 38 further comprising the step 
5 of calculating a signal to noise ratio from the spectra and deriving the gain from the 

signal to noise ratio. 

40. A method as claimed in claim 39 further comprising the step of modifying the 
signal to noise ratio with a scaling factor which gradually changes from a first value at 

10 onset of the signal to a second value at which the scaling factor remains as the signal 
continues, until the signal ceases at which time the scaling factor is rest to the first 
value. 

41. A method as claimed in claim 40 wherein the scaling factor changes in a 
15 plurality of steps. 

42. A method as claimed in claim 40 or claim 41 wherein the scaling factor changes 
exponentially. 

20 43. A method of calculating a spectrum from a coupled signal comprising the steps 
of: 

1) deriving a target signal component S and an interference signal 
component I from the coupled signal; 

2) transforming the target and interference signal components into respective 
25 frequency domain equivalents F(S) and F(I);and 

3) constructing the spectrum P(S) and P(I) of at least one equivalent in 
accordance with: 

P(S)=|Real(F(S))i + |lmag(F(S))l + G[F(S)]*R(S) 
P(I)=iReal(F(I))i + |lmag(F(I))| + G[Fa)]*R(I) 
30 Where Real and Imag refer to taking the absolute value of the real or imaginary 

part of the frequency domain equivalent R(S), R(I) are scalar adjustment factors 
and G[F(S)] and G[F(I)] are functions of F(S) and F(I) respectively. 
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44. A method of calculating a reverberation coefficient from a plurality of signals 
received from respective sensors in respective signal channels of a sensor array 
comprising the steps of: 

1 ) calculating a correlation time delay between signals from a reference one 
5 of the channels and another one of the channels using an adaptive filter; 

2) performing adaptive filtering, using a second adaptive filter, on the 
received signals;and 

3) calculating a reverberation coefficient from the filter coefficients of the 
first and second filters. 

10 

45. A method of signal processing of a signal having wanted and unwanted 
components comprising the steps of: 

1) processing the signal in the time domain with at least one adaptive filter 
to enhance the wanted signal and/or reduce the unwanted signal, 
15 2) transforming the thus processed signal to the frequency domain; and 

3) performing at least one unwanted signal reduction process in the 
frequency domain. 



46. 



Apparatus for performing the method of any one of the preceding claims. 
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